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Abstract. Stabilization of instable periodic orbits of nonlinear dynamical systems 
has been a widely explored field theoretically and in applications. The techniques 
can be grouped in time-continuous control schemes based on Pyragas, and the 
two Poincare-based chaos control schemes, Ott-Gebogi-Yorke (OGY) and difference 
control. Here a new stability analysis of these two Poincare-based chaos control schemes 
is given by means of Floquet theory. This approach allows to calculate exactly the 
stability restrictions occuring for small measurement delays and for an impulse length 
shorter than the length of the orbit. This is of practical experimental relevance; to 
avoid a selection of the relative impulse length by trial and error, it is advised to 
investigate whether the used control scheme itself shows systematic limitations on the 
choice of the impulse length. To investigate this point, a Floquet analysis is performed. 
For OGY control the influence of the impulse length is marginal. As an unexpected 
result, difference control fails when the impulse length is taken longer than a maximal 
value that is approximately one half of the orbit length for small Ljapunov numbers 
and decreases with the Ljapunov number. 



Floquet Stability Analysis of Ott-Grebogi-Yorke and Difference Control 



2 



1. Introduction 

Controlling chaos, or stabilization of instable periodic orbits of chaotic systems, has 
matured to a field of large interest in theory and experiment [Il|2l[3ll3l[5],[6l[71[Hlini [IHl 
im [T2I \T3\ [Ml [T5I [T6l [T7t [T8] . Most of these techniques are applied to dissipative systems, 
but with respect to applications as suppression of transport in plasmas, there has been 
recent interest also in controlling chaos in Hamiltonian systems [T9 | [20l [2T| [22l [23t [2^ [25] 
and in the stability of periodic orbits in multidimensional systems [26]. Control of chaos 
in general, however, does not rely on the existence of a Hamiltonian, so the system can 
be given as any dynamical system described by a set of differential equations, or can 
be an experimental system. The aim of chaos control is the stabilization of unstable 
periodic orbits (UPOs), or modes in spatial systems. The central idea of the Hiibler 
and Ott-Grebogi-Yorke approaches to the control of chaos is to utilize the sensitive 
dependence on initial conditions, be it system variables p^, or system parameters [2] 
to steer the trajectory on an (otherwise unstable) periodic orbit of the system. To 
accomplish this task, a feedback is applied to the system at each crossing of a suitably 
chosen Poincare plane, where the feedback is set proportional to the actual deviation of 
the desired trajectory. Contrary to Pyragas control [3], where control is calculated quasi 
continuously at a high sampling rate, here the approach is to stabilize by a feedback 
calculated at each Poincare section, which reduces the control problem to stabilization of 
an unstable fixed point of an iterated map. The feedback can be chosen proportional to 
the distance to the desired fixed point (OGY scheme), or proportional to the difference 
in phase space position between actual and last but one Poincare section. This latter 
method, difference control [4J, or Bielawski-Derozier-Glorieux control, being a time- 
discrete counterpart of the Pyragas approach [3], allows for stabilization of inaccurately 
known fixed points, and can be extended by a memory term [271 [2H] to improve stability 
and to allow for tracking [7] of drifting fixed points [27] . 

In this paper the stability of perturbations x{t) around an unstable periodic orbit 
being subject to a Poincare-based control scheme is analyzed by means of Floquet theory 
|29j . This approach allows to investigate viewpoints that have not been accessible by 
considering only the iteration dynamics between the Poincare sections, as measurement 
delays and variable impulse lengths. The impulse length is, both in OGY and difference 
control, usually a fixed (quasi invisible) parameter; and the iterated dynamics is uniquely 
definded only as long as this impulse length is not varied. The influence of the impulse 
length has not been point of consideration before; if mentioned at all, usually a relative 
length of approximately 1/3 is chosen without any reported sensitivity. Whereas for the 
Pyragas control method (in which the delayed state feedback enforces a time-continuous 
description) a Floquet stability analysis is known [30], here the focus is on the time- 
discrete control. 

1.1. Floquet stability analysis 

The linearized differential equations of both schemes are invariant under translation in 
time, t ^ t + T. Herby, we assume that the system under control is not explicitely 
time-dependent. According to the theory of delay-differential equations [29], a stability 
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condition can be derived from a simple eigenvalue analysis of Floquet modes. The 
Floquet ansatz expands the solutions after periodic solutions u{t + T) = u{t) according 
to 

x(t) = e<%^{t). (1) 

The necessary condition on the Floquet multiplier e'''^ of an orbit of duration T for 
stability of the solution is Re7 < 0; and x{t) = refers to motion along the orbit. 
In Poincare-based control the effective motion can be transformed into the unstable 
eigenspace, see e.g. App. A in [2Bj; the stability is governed by the motion therein. For 
the case of one unstable Lyapunov exponent, this subspace is one-dimensional. 

1.2. OGY control 

The method proposed by Ott, Grebogi and Yorke [2] applies a control amphtude 
r{t) = e{t){x{ty^) — X*), in vicinity of a fixed point x*. Here e{t) is a (possibly time- 
dependent) feedback gain parameter, and x(tx) is the position of the last Poincare 
crossing. Without loss of generality, we can place the fixed point at x = 0, so that 
the OGY feedback scheme becomes r{t) = e{t)x(tx), where = t — (t mod T) is 
the time of the last Poincare crossing. Now one considers the linearized motion in 
vicinity of an unstable periodic orbit (which is a stable periodic orbit of a successfully 
controlled system). The Poincare crossing reduces the dimensionality from to — 1 
dimensions, in the lowest-dimensional case from 3 to 2. In this case it is sufficient 
to consider a linearized one- dimensional time-continuous motion around the orbit, 
x{t) = Xx{t) + fir{t), which now can be complex- valued to account for flip motion 
around the orbit [30j, i.e., one has the dynamical system 

x{t) = Xx{t) + iiexit - {t mod T)). (2) 

Without control {r{t) = 0), the time evolution of this system is simply x{t) = e'^^ and the 
Ljapunov exponent of the uncontrolled system is Re A. Here it must be emphasized that 
assuming constant A and is a quite crude approximation, so only qualitative results can 
be concluded. Now we see - a central observation - that no delay-differential equation 
[29] is obtained: As the "delay" term always refers to the last Poincare crossing, this 
type of dynamics can be integrated piecewise. In the first time interval between t = 
and t = T the differential equation reads 

Vo<t<T i(t) = \x(t) + fiex{0). 

Integration of this differential equation yields 

= ((1 + f )e^* - f ) x(0). 

This gives us an iterated dynamics (here we label the begin of the time period again 
with t) 

x(t + T)=((l + /^)e^^-/^)x(t). 

This equation allows to determine the Floquet modes x{t + T) = e''^x{t) by inspection. 
The Floquet multiplier e"^^ of an orbit, assuming an impulse duration of full orbit length, 
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therefore is given by 



The remainder of the paper investigates, both for OGY and difference control, how the 
Floquet multiplier is modified for different impulse lengths. 



2. Influence of impulse length: OGY case 

The time-discrete viewpoint now allows to investigate the influence of timing questions 
on control. First we consider the case that the control impulse is applied timely in the 
Poincare section, but only for a finite period pT within the orbit period (0 < p < 1) 
(see Fig. [1^). 



s{t) 



e{t) 
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Figure 1. Impulse shapes considered for £(i), resulting in the Floquet multipliers (O 
for a finite impulse length (a), and pO|l if one also adds an additional delay of duration 
s(b). 



This situation is described by the differential equation 

x{t) = Xx{t) + fiex{t - {t mod T))0((t mod T)-p), (4) 

here is a step function {Q{x) = 1 for a; > and Q{x) =0 elsewhere). In the first time 
interval between t = and t = pT the differential equation reads x(t) = \x{t) + fiex{0). 
Integration of this differential equation yields 



V, 



0<t<pT 



X{t) 



(l + f)e^'-f )-(0). 



(5) 



In the second interval between t = pT and t = T the differential equation is the same 
as without control, x{t) = Xx{t). From this one has immediately 

.Mt-pT)^(„T') (6) 



V,T<t<T xit)=e'^'-^'hipT) 
and the Floquet multiplier of an orbit is given by 



e^^ = e^^ 



l + f(l-e-^-^)). 



(7) 



The consequences are shown in Fig. [2l One finds that in zero order the "strength" of 
control is given by the product pTue; in fact there is a weak linear correction in p. This 
analysis reproduces well the experimental results of Mausbach [3S]- For XpT < 1 one 
has 



2 



(8) 
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i.e. the condition of a constant strength of control reads 

^ispT = = i + ^p + oip'). (9) 

1-—P 2 

The result is: Apart from a weak linear correction for OGY control the length of the 
impulse can be chosen arbitrarily, and the "strength" of control in zero order is given 
by the time integral over the control impulse. 




Figure 2. Left: Dependence of OGY control on the duration 1 < pT < T and strengtli 
of control. Control is possible within the shaded areas, where darker shadings refer to 
smaller Re7, including an optimal line inbetween where Re7 — > — oo. In the white 
areas, Re7 is positive, there the system with applied control becomes unstable. Right: 
Plot in the (p, /iep) plane, the product ^ep shows only a weak dependency on p. This 
supports that the linear approximation ([H]) is a good approximation for ([7]). 



For the case where the system can only be measured delayed - by a delay time of 
the orbit length and longer - stability borders [311 [32] and improved control schemes 
have been given in [28], [33] and successfully applied experimentally [27], [31], [35]. In 
experimental situations one often has the intermediate case that there is a measurement 
delay sT that is not neglectable, but within the orbit length. To keep the case general, 
we again consider a finite impulse length pT with < p < 1 und < (s + p) < 1, see 
Fig. [T]d. Again we can integrate piecewise, and the Floquet multiplier is given by 

e^^ = e"^ {l + ^e-^^^(l - e'^^'^)) (10) 

and ([7() is included as the special case of s = 0. 
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3. Impulse length influence: Difference control 



Now we analyze the difference control scheme [1] 
r{t) = £:(x(tx) - a;(txx)), 



(11) 



where and tx x denote the times of last and last but one Poincare crossing, respectively. 
Again the starting point is the linearized equation of motion around the periodic orbit 
when control is applied. For difference control now there is a dependency on two past 
time steps, 



Although the right hand side of (fT2l) depends on x at three different times, it can be 
nevertheless integrated exactly, which is mainly due to the fact that the two past times 
(of the two last Poincare crossings) have a fixed time difference being equal to the orbit 
length. This allows not only for an exact solution, but also offers a correspondence to 
the time-discrete dynamics and the matrix picture used in time-delayed coordinates. 

Now also for difference control the experimentally more common situation of a 
finite but small measurement delay sT is considered, together with a finite impulse 
length sT (here < p < 1 and < {s + p) < 1). An analogeous calculation [331 EI] as 
for the OGY case can also be performed as follows. Piecewise integration in the first 
interval < t < T ■ s, where the differential equation reads x(t) = \x(t), yields again 
x{T ■ s) = e^'^'^x{0). In the second interval T ■ s < t < T ■ (s+p) the differential equation 
reads 



x(t) = \x{t) + jjisxit — {t mod T)) 

— iiex{t — T — {t mod T)). 



(12) 



x{t) = \x{t) + fie{x{0) - x{-T)). 



Integration yields 



Vr-s<t<T-(s+p) 



x{t) 




x{T-{s + p)) = - ^{x{0) - x{-T)) 



^(x(0) - x{-T)) + e^P^ + e^(^+^')^x(0). 



For the third interval again there is no control, thus 




(13) 
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Figure 3. Time- continuous stability analysis of difference control with consideration 
of the length of the control impulse: Contour plot of the real part of the Floquet 
exponent in (ImA,/ie) space for T = 1, s = 0,p = 0.3, ReA — 0.2 (left) and RcA ~ 0.6 
(right). For ImA — tt one finds (above ReA = 0.52) an island of stability, which 
completely disappears for -p > Pmax (Fig- E]). The Floquet analysis shows that the 
impulse length is of fundamental importance for the dynamical behaviour and stability 
of difference control, contrary to the situation for OGY control. The contour lines show 
the real part of the Floquet multiplier for (outer), -0.03, and -0.1 (inner contour). 
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Figure 4. Time-continuous stability analysis of difference control with consideration 
of the length of the control impulse: Stability area for fixed twist ImA = tt and 
independence of amplitude iie and relative impulse length p, for T ~ l,s = 0, 
ReA = 0.2 (left) and ReA = 0.6 (right). 
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Figure 5. Time-continuous stability analysis of difference control: Maximal impulse 
length p for different values of ReA in the range from 0.01 to 1.0. 



If we identify with the coefficients of the time-discrete case, Ad = e'^"^ and Hd£d = 
g-AsTj^]^ — e^^^)^, the dynamics in the Poincare iteration t = nT becomes identical 
with the pure discrete description; this again illustrates the power of the concept of 
the Poincare map. In principle, due to the low degree of the characteristic polynomial, 
one could explicitely diagonalize the iteration matrix, allowing for a closed expression 
for the n-th power of the iteration matrix. However, for the stability analysis only the 
eigenvalues are needed. For the Floquet multiplier one has 



_gAT/^g-A.T(^_g-ApT^_ (14) 

A 



This quadratic equation yields two Floquet multipliers, 

lj,e 

T 



e7T = ie"T^ ^^g-AsT^_g-ApT. 




AT(i + ^e-AsT(i_g-ApT))y 



+ 4eAT/^e-A.T(i _e-Apr)_ 
A 



Figures [3] and H] show, by example of ReA = 0.2, (resp. ReA = 0.6) that at ImA = vr 
for p < Pniax(ReA = 0.2) ~ 0.505401 (resp p < Pmax(ReA = 0.6) ~ 0.367) there exists 
an island of stability, whose width decreases to zero for p — > Pmax- Here exphcitely the 
influence of the impulse length can be seen. The maximal value of Pmax is shown in 
Fig.O 
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4. Discussion of the time-continuous model: Relaxing the assumption of a 
constant local Ljapunov exponent 

The quantitative analysis given above was based on the model assumption that one has 
a constant local Ljapunov exponent around the orbit - a condition that will almost 
never be fulfilled exactly for a typical orbit of a chaotic system. To test whether this 
assumption is crucial, the stabihty can be investigated for OGY control by assuming A 
to be time-dependent along the orbit. For simplicity, we consider the exemplaric case 
shown in Fig. [6]that X(t) = Ai for < t < gT and X(t) = A2 for qT < t < T, generalizing 
the case q = 1/2 already sketched in [37] . 



4.1. The case p < q of a short impulse 



e{t) 





Ai 

A2 + 




pT 



t 



qT T 
Figure 6. Impulse shapes e(t) and time- varying X{t): Case of a short impulse p < q. 



If we assume p < q, we have for the OGY case, 

xipT) = {e^^P^'il + (/i£/Ai)) - (/i£/Ai))x(0) 
xiqT) = e^i('?^-P^)x(pr) 

x{T) = e^2(^-«^)x(gT). (15) 
Using A := gAi + (1 — g)A2, the Floquet multiplier reads now 

e^^ = e^^fl + ^(l-e-"^P^)') (16) 



Ai 

in contrast to eq. (171). Again in zero order the "strength" of control is given by the 
product pfJ^e; in first order XipT < 1 again the weak linear dependence on p applies, 

i.e. for a constant "strength" of control, one has to fulfill 

/xepT = \^ + o(p2) = 1 + + o(p2). (18) 

1 — ^p 2 

Thus, the value of Ai, i.e. here, the deviation of \(t) from its average value A during the 
control impulse, only contributes in first order. More complicated cases can be tackled 
likewise, giving corrections for the quantitative p-dependence of the optimal control gain 
e, but preserving the qualitative behaviour discussed above. 
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4-2. The case p > q of a long impulse 

While a short impulse is the experimentally more feasible case, for completeness, also 
the p > q shown in Fig. [7] can be investigated in this manner. Here we have two time 
intervals where the control is active; and in the second one the initial condition x{pT) 
has to be distinguished from the position x(0) at the last Poincare crossing, from which 
the control value is calculated and which determines the inhomogenity of the ODE. 



s{t) 



Ai 

A2 



pT 



T 



qT 



T 



Figure 7. Impulse shapes e(i) and time- varying \{t): Case of a long impulse p > q. 



Integration over the three time intervals yields 

x{qT) = e^^''^x(0)(l + ^) - x(0)^ 



x{pT) = e^'^P'^-'^^UxiqT) + x{0)^) - a;(0)^ 
^ A2 ^ A2 



,A2 (T-pT) 



x{T) = e 
so that we arrive at 

x{T) = x(0)e^^ 



x{pT) 



g-A2(p-g)TXg-AigT 



(19) 



Weakly nonlinear approximation for q = 1/2 As p > q, and g is a fixed value for the 
given system, a discussion of pXT <C 1 can no longer be based on the p — > case. As 
p is of order 1, an expansion as above is meaningful only for the case where AT <C 1, 
i.e., we derive an approximation for those UPOs which have an only marginally positive 
Floquet multiplier. For q = 1/2 we now explicitely discuss this "weakly nonlinear" case 
AiT < 1, A2T < 1, 
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A2T(p - i) + 
-AiT(p-i) + o(A?,AiA2,A2) 



AiT XjT^ 



that is, control is kept constant in lowest order for 
fieT I 1 



2 i_Air(p-i)- 

for orbits sharing the same value of A. 



l + X,T{p--) 



(20) 
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4-3. Difference control and nonconstant local Ljapunov exponent 



For completeness, now also the case of difference control is considered. As has been 
shown before, for the case of a constant Ljapunov exponent, impulse lengths of p > | 
do not lead to stable control; therefore the case p > q is completely irrelevant, and only 
the case p < q has to be be considered. In the first interval, Ai is active and integration 
yields 



x{pT) 



xiT) 



^(0)(l + f (e- 



and the subsequent intervals have the control switched off. 



,AT 



a:(0)(l + ^(e-^^^^ 
Ai 



^1 



(21) 

(22) 
(23) 



Again we use the average value A = Aig + A2(l — q) to simplify the expressions, and the 
coordinates in the Poincare countings Xn+i = x(T), x„ = a;(0), Xn-i = x(— T). We have 

/ e^^(l + f (e-^^f^ - 1)) -e^^^(e-^iP^ - 1) \ 



Xrt. 



which leads to the characteristic equation for the two Floquet multipliers e'^'^ 



(1 + 



Ai 



l))_e^^^(e-^iP^ 
Ai 



1). 



(24) 



(25) 



This generalizes the discussion of difference control to the case of nonconstant A. 



5. Conclusions and Outlook 



To summarize, a new time-continuous stability analysis of Poincare-based control 
methods was introduced. This general and novel approach allows to investigate timing 
questions of Poincare based control schemes that cannot be analyzed within the picture 
of the Poincare iteration. For both OGY and difference control it has been possible 
for a homogeneous case to integrate the dynamics exactly. While for OGY control the 
impulse length turns out not to be crucial, for difference control it is, and the impulse 
has to be shorter than a critical fraction of the period, which is of the order of half of 
the period and decreases for larger Ljapunov exponents. Such timing dependence is not 
completely uncommon in feedback systems with delay; in time-continuous feeedback 
control, a half-period feedback resulted in an enlarged stability range [38] . 

Techniques of chaos control, be it Poincare-based, following the Pyragas technique, 
or open- loop P3| [39l HOf HT| H2] have been of great interest not only in technical systems, 
but also in biologically, especially neural systems and excitable media [SI Il5] . Besides 
the approach of controlling pathological neural subsystems directly, the intact brain 
already bears implementations of feedback control [50], implying that the failure of the 
respective circuits eventually results in migraine or stroke. Also the human gait system, 
as virtually any perception-motor system, performs control of a bio-mechanical system 
with delays; and disturbances of the delay loops as well as the cortical control may 
result in tremor and related movement disorders HSl STl HSl HQ] . In the thalamocortical 
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system, a designated impulse shape, formed by the so-called slow waves that emerge in 
the cortex during S2 sleep, has been shown to act as an open-loop controller of thalamic 
oscillator networks [51]. This offers further possibilities to influence human sleep in 
the case of sleep disturbances: Recent control techniques by transcranial electrical or 
magnetic stimulation [52l [531 EH [55] have been demonstrated to influence human sleep 
as well as to affect memory consolidation during sleep. In most of these techniques, the 
impulse shape and relative duration of the control impulse has significant impact on the 
results, thus different control goals may become accessible within the same setup. For 
the systematic understanding how such control techniques influence the brain, detailed 
models are of likewise importance as the methodical understanding of the theoretically 
possible control methods. 
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